Mirror feedback upon physical object selection

ABSTRACT

A highlighting method and an interaction system ( 100 ) include a switchable mirror ( 110 ) facing a first side of an item ( 120 ) having a second side facing a viewer ( 130 ); and a processor ( 220 ) configured to perform switching the mirror from a transparent or non-transparent state to a reflective state so that said first side of said item ( 120 ) becomes visible to the viewer ( 130 ) through reflection from the switchable mirror ( 110 ). A light source ( 170 ) is configured to provide incident light to the switchable mirror ( 110 ) for reflection from the switchable mirror ( 110 ) in the reflective state for illuminating the first side of the item ( 120 ).

This application is a national stage application under 35 U.S.C. §371 ofInternational Application No. PCT/IB2007/051743 filed on May 9, 2007,and published in the English language on Dec. 6, 2007 as InternationalPublication No. WO/2007/138504, which claims priority to EuropeanApplication No. 06114760.9, filed on May 31, 2006, incorporated hereinby reference.

The present invention relates to an interaction solution for providingsystem feedback as result of the user selecting an object in theinteractive shop window, for example, based on using a switchablesurface such as a mirror mounted behind the object, where colored lightmay be reflected by the mirror, for example.

For entertaining customers and for the sake of providing extrainformation about products, retailers already deploy various displaytechnologies ranging from large LCD or plasma displays to transparentprojection screens. These displays can often be found installed in shopwindows where they are used to display video clips, a slide show withannouncements or information about the shop or their products. Most ofthe currently used shop window displays are pure informativenon-interactive screens. More advanced shop window displays offer someinteractivity with the display on a basic level, where a user can pressa button on or near the display to activate some functionality, such asgo to a next or previous page.

A more attractive shop window can be realized by combining physicalproducts exhibited behind the shop window and a shop window display thatwould show information about the product the user is interested in. Sucha shop window display system may infer the interest of the user eitherusing gaze tracking or pointing gestures detection, as described inEuropean Patent Application Serial Number 05107205.6, filed Aug. 4,2005, entitled “Augmented Shop and Show Windows” which is incorporatedherein by reference in its entirety. In such an interactive shop window,the user may look or point at a physical product. The looking/gazingand/or pointing is detected by the shop window, in response to which theshop window displays information about the product on the display. Sucha shop window is advantageous since it enables both being able toactually see the real physical product and at the same time getadditional (digital) information, including various interactive servicesprovided/suggested on the display.

In typical Graphical User Interface (GUI) design practice, feedbackregarding system status is often provided. This principle follows one ofthe usability heuristics that stresses the importance of the visibilityof system status. Such a principle follows the notions that the systemshould always keep users informed about what is going on, throughappropriate feedback within reasonable time. Following this principle inGUI design, it is a common practice to highlight an item of focus or theone that has been activated by the user. For tangible user interfaces,it has been demonstrated to highlight a physical object using aprojection, e.g. in what is referred to as reactTable or SmartSkin.Further, a switchable linear polarizer for realizing a display mirrorthat can switch between reflective and transmission mode is alsodescribed in U.S. patent application Ser. No. 10/507,730, entitled“Mirror With Built-In Display,” which is incorporated herein byreference in its entirety.

In shop windows for example, it is important to provide customers withfeedback indicating which product is selected by ‘highlighting’ theproduct, similar to the feedback techniques used in GUIs. However, ahighlighting using a projection or a spot light will be hardly visible,particularly during daylight, since most shop windows are placed outsideand exposed to natural light. Another problem with using a spot lightfor product highlighting is that the system will be limited with respectto the number of products that can be highlighted, as many spot lightsare needed that are directed to shine on the various products. Anotherlimitation is that the layout of the products, or shelves containing theproducts, needs to be adjusted for proper combination of productplacement and spot lights locations/direction of the shining lightstherefrom, so that no product is placed in the way of the spot light toprevent light blockage from the spot light to the desired/illuminatedproduct.

Another problem is that when products are exhibited behind the glass ofa shop window for example, only the front part(s) of the product(s)facing the user/viewer can be viewed. That is the back of the product isnot viewable by the user/viewer. For showing the back of the product, abulky electromechanical rotating platform would need to be used forevery product, which is in most cases too cumbersome and expensive toinstall and move as the decoration of, or product placement in, the shopwindow is changed.

Accordingly there is a need for a better interactive system forproviding feedback as result of the user selecting an object in theinteractive shop window, for example, based on using a switchable mirrormounted behind the object, which can also be used in combination with alight source including colored light that is directed to and reflectedby the mirror, where also the backside of the object is viewable by theuser.

One object of the present systems and methods is to overcome thedisadvantage of conventional interactive systems.

This and other objects are achieved by systems and methods that includea highlighting method and an interaction system comprising a switchablemirror facing a first side of an item having a second side facing aviewer; and a processor configured to perform switching the mirror froma transparent state to a reflective state so that the first side of theitem becomes visible to the viewer through reflection from theswitchable mirror. Further, a light source is configured to provideincident light directed to the switchable mirror for reflection from theswitchable mirror in the reflective state for illuminating the firstside of the item. Any controllable light source which may include atleast one of a light emitting diode, incandescent, fluorescent, halogen,and high intensity discharge light source.

The systems and methods for providing feedback are responsive to userselection of a physical object, e.g., displayed in a shop window. Theuser selection may be effectuated with a gesture, gaze or by any otherselection means. The systems and methods may be used in differentlighting conditions including natural light. The systems and methodsinclude using a mirror mounted behind an object, for example, and assuch the systems and methods provide an additional advantage in that theback of the object is visible to the user.

Further areas of applicability of the present systems and methods willbecome apparent from the detailed description provided hereinafter. Itshould be understood that the detailed description and specificexamples, while indicating exemplary embodiments of the systems andmethods, are intended for purposes of illustration only and are notintended to limit the scope of the invention.

These and other features, aspects, and advantages of the apparatus,systems and methods of the present invention will become betterunderstood from the following description, appended claims, andaccompanying drawing where:

FIG. 1 shows an interactive system according to one embodiment of thepresent invention; and

FIG. 2 shows a block diagram according to another embodiment of thepresent invention.

The following description of certain exemplary embodiment(s) is merelyexemplary in nature and is in no way intended to limit the invention,its application, or uses. In the following detailed description ofembodiments of the present systems and methods, reference is made to theaccompanying drawings which form a part hereof, and in which are shownby way of illustration specific embodiments in which the describedsystems and methods may be practiced. These embodiments are described insufficient detail to enable those skilled in the art to practice thepresently disclosed system and it is to be understood that otherembodiments may be utilized and that structural and logical changes maybe made without departing from the spirit and scope of the presentsystem.

The following detailed description is therefore not to be taken in alimiting sense, and the scope of the present system is defined only bythe appended claims. The leading digit(s) of the reference numbers inthe figures herein typically correspond to the figure number, with theexception that identical components which appear in multiple figures areidentified by the same reference numbers. Moreover, for the purpose ofclarity, detailed descriptions of well-known devices, circuits, andmethods are omitted so as not to obscure the description of the presentsystem.

FIG. 1 shows an interactive system 100 having a switchable mirror 110located behind an object or item 120 viewed by a viewer or user 130 fromthe front side of the object 120. The object/item 120 may be any item,such as a product displayed in a shop window, in which case theretypically is a transparent glass, plastic or other transparent materialor panel 140 between the object 120 and the viewer 130. It should beunderstood that the object 120 and the location may be any object andlocation displayed for viewing or using by the viewer/user 130. Forexample, the object 120 may be artwork displayed in a museum forinteractive physical exhibits, with or without any material 140 betweenthe object 120 and the viewer 130.

Further, many objects 120 may be displayed in close proximity orotherwise. An item selection means allows selection of one or more ofthe objects 120, such as via detectors that detect viewer's gaze and/orpointing at the physical item 120, or pointing to a virtual itemdisplayed on a screen of a device, e.g., screen of a portable devicesuch as a personal digital assistant (PDA) or mobile phone thatcommunicates with the system 100 through a short range wireless link,such as Bluetooth. The window showcase for example is mapped onto thescreen of the device, where the user 130 can point on the screen andselect one or more of the objects 120. In response to user selection ofan item(s) 120, the interactive system 100 is configured to providefeedback related to the selected item 120. The feedback may be in theform of highlighting the selected item, such as providing lightreflected from the switchable mirror 110 and to the back side to theselected item 120. Further the switchable mirror 110, in the reflectivestate, provides a view of the back side of the item 120.

The user may select an item 120 among many items by pointing to theobject itself where, as shown in FIG. 2 which illustrates a blockdiagram 200 according to another embodiment, a camera 210 connected to aprocessor 220 is configured to detected the user selection, such asusing gaze tracking or pointing gestures detection, as described inEuropean Patent Application Serial Number 05107205.6, filed Aug. 4,2005, entitled “Augmented Shop and Show Windows”. Alternatively, theuser may select an item 140 by pointing on a screen 230 displaying theplurality of selectable items, such as using a mouse or any otherinput/output device or simply his/her finger 240, such as a keyboard, ora pointer/finger in the case of a touch-sensitive display. As is wellknown, a memory 250 is provided which is operationally coupled to theprocessor 220 for storing data including operating system andapplication data to be accessed and executed by the processor to achievedesired functions and results.

Returning to FIG. 1, behind each item 120 exhibited in the shop windowfor example, the switchable mirror 110 is mounted at a desired angle,such as an angle that makes it comfortable for visitor or viewer 130 tosee the back of the product/item 120. In one embodiment, the switchablemirror 110 is made switchable between reflective and non-reflectivestates so that when the product 120 is selected by the user 130, theswitchable mirror 110 switches to its reflective state and will make theback of the product 120 visible to the customer 130.

This set-up can be realized by positioning a mirror 150 behind theproduct 120 and placing a switchable glass panel 160 between the product120 and the mirror 150. Illustratively, the switchable glass panel 160includes a PRIVA-LITE™ panel that can be switched between being opaqueor transparent with the controller 220, so that in the transparent statethe mirror 150 behind PRIVA-LITE™ 160 will be visible, and in the opaquestate the customer 130 sees the PRIVA-LITE™ diffusing surface that blockview of the mirror 150.

The PRIVA-LITE™ panels that may be used as the switchable glass panel160 are manufactured in Belgium by subsidiary of Saint Gobain GlassCompany, where such panels include a liquid crystal (LC) film sandwichedbetween to sheets of glass. The LC film includes LC in a polymer matrixsandwiched between conductive coatings. When the PRIVA-LITE™ panels isswitched off from its special power supply connected to the conductivecoatings, the liquid crystals are randomly scattered and diffuse lightin all directions. In its OFF state, the PRIVA-LITE™ is translucent andprevents both sides from seeing through the glass panel. By providingpower and switching the PRIVA-LITE™ panel ON, the liquid crystals lineup and re-orientate themselves, turning the PRIVA-LITE™ totallytransparent.

Alternatively, other panels that are switchable between transparent andnon-transparent states may be used, such as described in U.S. PatentApplication Publication Numbers 2004/0169789A1 and 2004/0229049, whichare incorporated herein by reference in their entirety. Of course, themirror 150 and switchable glass 160 may be integrated as one unitinstead of being separate units. Other switchable mirrors or reflectivefilms may also be used, such as described in U.S. Patent ApplicationPublication Number 2004/0021921 A1, and International Publication NumberWO 02/01288A1, which are incorporated herein by reference in theirentirety. Further, as noted above, a switchable polarizer may be usedfor realizing the switchable mirror 110, including λ/2 retarders andswitchable polarizing filters, as described in above-noted U.S. patentapplication Ser. No. 10/507,730. The switchable polarizer is switchablebetween a reflective and transparent mode.

In response to selection by the user 130 of an item 120, the switchablemirror 110 located behind the item 120 is switched from the transparentor opaque mode to the reflective mode, where otherwise the switchablemirror 110 is in the transparent or opaque mode, which is the defaultmode, for example. It may be desirable to use switchable mirrors thatchange states between transparent and reflective modes, instead ofswitchable mirrors that change states between opaque and reflectivemodes, so that in the transparent mode, other objects behind theswitchable mirror 110 may be visible to the viewer 130.

Providing feedback by switching on the switchable mirror 110 can be mademore noticeable if simultaneously to the activation of the mirror mode,a light source 170 is switched on which provides light rays 175 directedtowards the mirror 150. In this case the reflected light 180 (reflectedfrom the mirror 150) will highlight the product 120, as if a lamp isplaced behind the product 120. By using a controllable light source,such as a red, green and blue (RGB) light emitting diode (LED) lightsource, it becomes possible to change the color of the light 175directed to the mirror 150 and then reflected to the product 120.

LEDs are light sources that are particularly well suited to controllablyprovide light of varying attributes, as LEDs may easily be configured toprovide light with changing colors, intensity, hue, saturation, beamwidth, spot size and other attributes, and typically have electronicdrive circuitry for control and adjustment of the various lightattributes. However, any controllable light source may be used that iscapable of providing lights of various attributes, such as variousintensity levels, different colors, hue, saturation, beam width, spotsize and the like, such as incandescent, fluorescent, halogen, or highintensity discharge (HID) light and the like, which may have a ballastor drivers for control of the various light attributes.

Further, using colored light allows for color coding. Thus, for example,color-coding may be used to distinguish between feedback provided todifferent users interacting with the shop window simultaneously, whereuser A is assigned the color red, user B is assigned the color green,user C is assigned the color blue, user D is assigned the color orangeor any combination of color, hue, saturation and/or light intensity. Insuch a color-coded scheme, each user receives feedback using the colorassigned to that user by the system, or an available color selected bythe user, e.g., from the user's PDA or other devices that areoperationally coupled to the system 100, through any links, wired orwireless for example.

In addition, color coding may be used to indicate ‘related’ productswith the same color. Of course, one skilled in the art may devisevarious combination of color-coding in view of the present disclosure,such as using same or similar colors for highlighting related products,with same or similar light attributes, such as same or similar intensityhue, saturation and the like. Illustratively, the color intensity variesfrom its maximum, illuminating the user-selected product, to lowerintensity for illuminating other related products, where for example,the next most relevant product, or promotional product which is on saleat a discounted price is illuminated with a lower intensity level, andfurther products are illuminated with even lower intensity levels andthe like. Related products may be products of the same brand as theuser-selected product, the same product category, and/or compatibleproducts. For example, when the user selects a photo camera, thenrelated products that may be illuminated with light having any desiredlight attribute may be memory cards, batteries, printer, etc.

Of course, as it would be apparent to one skilled in the art ofcommunication in view of the present description, various elements maybe included such as a light source controller which may be separate orintegrated with the processor. The controllable light source includesdrivers and may also include other elements, such as elements forwireless communication and control including one or more transmitters,receivers, or transceivers, antennas, modulators, demodulators,converters, duplexers, filters, multiplexers etc., which may also beincluded or coupled to the processor or controller for wireless lightcontrol. Such well-known elements will not be further described in ordernot to obscure description of the present system and method.

As is well-known, the processor 220 executes instruction stored in thememory 250, for example, which may also store other data, such aspredetermined or programmable settings related to control of the lightsource(s), including programmable grouping of lights and lightattributes/settings to illuminate related, relevant or desired products,such as intensity (i.e., dimming function), color, hue, saturation, beamwidth, direction, color temperature, mixed colors, and the like, for thecase of light source that may be controlled to change attributes oflight emanating therefrom. Of course, the desired color attributes maybe the same or different for groups or for lighting units within onegroup. That is, individual light units may provide light of differentdesired attributes despite being in a single group associated with asingle consumer. Thus, one group of light sources provides a particularcolored-light, where other light attributes may be varied, such as theintensity for example, to highlight/illuminate items 120 with varyingdegrees of highlighting.

It should be understood that the various component of the interactionsystem may be operationally coupled to each other by any type of link,including wired or wireless link(s), for example. Various modificationsmay also be provided as recognized by those skilled in the art in viewof the description herein. The memory may be any type of device forstoring application data as well as other data. The application data andother data are received by the controller or processor for configuringit to perform operation acts in accordance with the present systems andmethods.

The operation acts of the present methods are particularly suited to becarried out by a computer software program, such computer softwareprogram preferably containing modules corresponding to the individualsteps or acts of the methods. Such software can of course be embodied ina computer-readable medium, such as an integrated chip, a peripheraldevice or memory, such as the memory or other memory coupled to theprocessor of the controller or light module.

The computer-readable medium and/or memory may be any recordable medium(e.g., RAM, ROM, removable memory, CD-ROM, hard drives, DVD, floppydisks or memory cards) or may be a transmission medium (e.g., a networkcomprising fiber-optics, the world-wide web, cables, and/or a wirelesschannel using, for example, time-division multiple access, code-divisionmultiple access, or other wireless communication systems). Any mediumknown or developed that can store information suitable for use with acomputer system may be used as the computer-readable medium and/ormemory 250.

Additional memories may also be used. The computer-readable medium, thememory 250, and/or any other memories may be long-term, short-term, or acombination of long- and -short term memories. These memories configurethe processor/controller 220 to implement the methods, operational acts,and functions disclosed herein. The memories may be distributed or localand the processor, where additional processors may be provided, may bedistributed or singular. The memories may be implemented as electrical,magnetic or optical memory, or any combination of these or other typesof storage devices. Moreover, the term “memory” should be construedbroadly enough to encompass any information able to be read from orwritten to an address in the addressable space accessed by a processor.With this definition, information on a network is still within memory,for instance, because the processor may retrieve the information fromthe network.

The processor 220 and the memory 250 may be any type ofprocessor/controller and memory, such as those described in U.S.2003/0057887, which is incorporated herein by reference in its entirety.The processor may be capable of providing control signals and/orperforming operations in response to selecting and grouping lightmodules and/or selecting predetermined or programmable light settings,and executing instructions stored in the memory. The processor may be anapplication-specific or general-use integrated circuit(s). Further, theprocessor may be a dedicated processor for performing in accordance withthe present system or may be a general-purpose processor wherein onlyone of many functions operates for performing in accordance with thepresent system. The processor may operate utilizing a program portion,multiple program segments, or may be a hardware device utilizing adedicated or multi-purpose integrated circuit. Each of the above systemsutilized for identifying the presence and identity of the user may beutilized in conjunction with further systems.

An interaction feedback has been described as result of the userselecting an object in the interactive shop window, for example. Thefeedback may be based on using a switchable surface, such as a mirrormounted behind the object, where colored light may be reflected by themirror, for example. Advantages of the interaction feedback includesshowing the backside of the object, drawing and keeping the user'sattention, providing useful information, and highlighting desiredfeatures of the object(s) selected by the user, as well assuggesting/highlighting other objects that may be of interest to theuser.

Of course, it is to be appreciated that any one of the above embodimentsor processes may be combined with one or with one or more otherembodiments or processes to provide even further improvements in findingand matching users with particular personalities, and providing relevantrecommendations.

Finally, the above-discussion is intended to be merely illustrative ofthe present system and should not be construed as limiting the appendedclaims to any particular embodiment or group of embodiments. Thus, whilethe present system has been described in particular detail withreference to specific exemplary embodiments thereof, it should also beappreciated that numerous modifications and alternative embodiments maybe devised by those having ordinary skill in the art without departingfrom the broader and intended spirit and scope of the present system asset forth in the claims that follow. The specification and drawings areaccordingly to be regarded in an illustrative manner and are notintended to limit the scope of the appended claims.

In interpreting the appended claims, it should be understood that:

a) the word “comprising” does not exclude the presence of other elementsor acts than those listed in a given claim;

b) the word “a” or “an” preceding an element does not exclude thepresence of a plurality of such elements;

c) any reference signs in the claims do not limit their scope,

d) several “means” may be represented by the same item or hardware orsoftware implemented structure or function;

e) any of the disclosed elements may be comprised of hardware portions(e.g., including discrete and integrated electronic circuitry), softwareportions (e.g., computer programming), and any combination thereof;

f) hardware portions may be comprised of one or both of analog anddigital portions;

g) any of the disclosed devices or portions thereof may be combinedtogether or separated into further portions unless specifically statedotherwise; and

h) no specific sequence of acts or steps is intended to be requiredunless specifically indicated.

The invention claimed is:
 1. An interactive system comprising: aplurality of items positioned between a viewing position and aswitchable mirror; and a processor operationally coupled to a memorywith application data and configured for receiving an indication of userselection for a selected one of the plurality of displayed items; andswitching said switchable mirror from a transparent state to areflective state so that a mirror-facing backside of said selected oneof the plurality of items becomes visible from the viewing positionthrough reflection from said switchable mirror; providing controlsignals in response to the indication of user selection to execute aprogrammable light setting.
 2. The interactive system of claim 1,further comprising a light source configured to provide incident lightto said switchable mirror for reflection from said switchable mirror insaid reflective state for illuminating said mirror-facing backside ofsaid selected one of the plurality of items in response to the controlsignals.
 3. The interactive system of claim 2, wherein said light sourcecomprises at least one of a light emitting diode, incandescent,fluorescent, halogen, and high intensity discharge light source.
 4. Theinteractive system of claim 1, wherein the indication of user selectionis at least one of pointing at said selected one of the plurality ofitems, gazing at said selected one of the plurality of items and/orselecting said selected one of the plurality of items from arepresentation thereof on a display.
 5. The interactive system of claim4, further comprising a detector configured to detect at least one ofsaid pointing and said gazing.
 6. The interactive system of claim 1,wherein said switchable mirror comprises a mirror and a switchable panellocated between said mirror and said plurality of items, said switchablepanel being switchable between a transparent state and a non-transparentstate.
 7. The interactive system of claim 6, wherein said switchablepanel includes a polarizer.
 8. A processor implemented method forviewing a selected object comprising: detecting a selection of one of aplurality of objects, wherein at least one of said plurality of objectshas a frontside and a backside opposite said frontside; and response tosaid selection of one of the plurality of objects, switching aswitchable mirror positioned behind the selected one of the plurality ofobjects from a transparent state to a reflective state; illuminatingsaid selected object by a light source to provide incident light to saidswitchable mirror; the light source configured to emit light forreflection from said switchable mirror in said reflective state forilluminating a backside of said selected object.
 9. The method of claim8, wherein said selecting comprises at least one of pointing and gazingat said selected object or selecting said selected object from arepresentation thereof on a display.
 10. The method of claim 8, whereinsaid light source comprises at least one light-emitting diode forcontrollably providing incident light of at least one varying attribute.11. The method of claim 10, further comprising varying at leastattribute of said incident light based at least, in part on at least oneattribute of said item.
 12. An interactive system for illuminating aselected object by reflection, comprising: an item positioned between aviewing position and a switchable mirror, the item having a frontsidevisible to the viewing position and a backside not visible to theviewing position; a light source comprising at least one light-emittingdiode for controllably providing incident light of at least one varyingattribute to said switchable mirror; a processor operationally coupledto a memory with application data and configured for switching saidmirror from a transparent state to a reflective state in response to aselection signal generated in response to a user at said viewingposition; wherein the backside of said item becomes illuminated by saidlight emitted by the light source and visible to said viewing positionthrough reflection from said switchable mirror.
 13. The interactivesystem of claim 12, wherein said attribute is selected from the groupconsisting of: color, color temperature, intensity, hue, saturation,beam width, and spot size.
 14. The interactive system of claim 12,further comprising electronic drive circuitry for controlling said lightsource in coordination with said processor.
 15. The interactive systemof claim 12, wherein the attribute of said light is varied based atleast in part on at least one attribute of said item and/or saidselection.